System, apparatus, and method for providing illegal use research service for image data, and system, apparatus, and method for providing proper use research service for image data

ABSTRACT

In a system for providing an illegal use research service for image data, the image data received from a terminal apparatus is registered as a research subject, a research condition for research whether or not the image data being registered is illegally used by a Web site on the network is set, image data that are identical or similar to the image data being the research subject from a web site on the network are searched for based on a feature amount and the research condition, and a search result is informed as a research report to the research client using said terminal apparatus.

CROSS-REFERENCE TO RELATED APPLICATIONS

This Application is a Division of application Ser. No. 10/876,051 filedon Jun. 25, 2004, now U.S. patent Ser. No. ______.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention generally relates to a system, an apparatus, and amethod for providing illegal use research service for image data, andmore particularly to the system, the apparatus, and the method forproviding illegal use research service for image data, which searchingfor similar images to the image data requiring the user permit.

In addition, the present invention generally relates to a system, anapparatus, and a method for providing proper use research service forimage data, which research whether or not the image data which use ispermitted are properly used.

2. Description of the Related Art

Conventionally, a trademark research service has been provided by athird-party organization. An objective of this trademark researchservice is to observe other trademarks in order to protect a trademarkowned by an individual or an organization. This trademark researchservice periodically researches a new application or a newly registeredtrademark, and researches whether or not there is an identical orsimilar trademark (name, logo, naming) requested by a client. As aresult, when there is an identical or similar trademark requested by aclient, the result is summarized in a cut-paper form or a list form andthen reported to the client.

As an example of the trademark research service, the client fills atrademark, name, and category, which are subject to research, in arequest form, and sends the request form by fax or electronic mail. Inthis case, the client indicates one international classification as onesearch unit for one trademark, and can indicate three names for eachtrademark. Next, by a predetermined search condition, a search is alwaysconducted automatically at a constant precision. All trademarks beingidentical or including identical part to the trademark requested by theclient are output as a report. In a case of the similar trademark, 30cases from higher priority are output as a report. Published trademarkdata and application data, which are weekly updated, are used for asearch.

On the other hand, Japanese Laid-open Patent Application No. 2000-215238discloses a method for detecting an illegal literary work or search fora similar image, in which a feature amount registered beforehand iscompared with a feature amount obtained by a search and it is determinedwhether or not that searched work is an illegal literary work based onthat comparison result. In this method, it is determined whether or notan URL (Uniform Resource Locator), a file name, a file size, acalculated hash value, and a like being obtained as the feature amountare identical to information registered to a feature amount DB(DabaBase).

Japanese Laid-open Patent Application No. 2001-216323 discloses a systemin that a similarity of a design is considered, comparison data relatingto similarities of a plurality of attributes concerning a product designare maintained, and a search is conducted based on the comparison data.

However, in the above-described conventional trademark research service,since a search is conducted by utilizing a special DB provided andadministrated by a specific organization, it is difficult to researchother locations including other databases. Since only a text search canbe conducted through the Internet or the like, it is impossible tosearch for a feature of image data itself.

In addition, in the above-described inventions disclosed by bothJapanese Laid-open Patent Applications, a wider search can be possibleby using an Internet search robot. However, since a similarity or anot-similarity is determined by using predetermined data, it isdifficult to determine similarities derived from a file formatdifference, a modification difference, and a like. Accordingly, it isnot possible to search effectively with a sufficient flexibility.

SUMMARY OF THE INVENTION

It is a general object of the present invention to provide a system, anapparatus, and a method for providing illegal use research service forimage data, and a system, an apparatus, and a method for providingproper use research service for image data, in which the above-mentionedproblems are eliminated.

A more specific object of the present invention is to provide a system,an apparatus, and a method for providing illegal use research servicefor image data, in which when an illegal use research is conducted forthe image data requiring a user permit, a feature amount of the imagedata being a subject of the illegal use research can be calculated,image data being identical or similar to the image data being thesubject of the illegal use research from Web based on the calculatedfeature amount, and the search result can be informed as a researchreport to a research client.

The above objects of the present invention are achieved by a system forproviding an illegal use research service for image data, the systemincluding: a server apparatus for conducting an illegal use research ofthe image data requiring a use permit; and a terminal apparatus used bya research client requesting the illegal use research, the terminalapparatus connectable to the server apparatus through a network, whereinthe server apparatus includes: a research subject registering partregistering the image data received from the terminal apparatus as aresearch subject to a research subject database for each researchclient; a research condition setting part setting a research conditionfor research whether or not the image data being registered is illegallyused by a Web site on the network; a similar image searching partcalculating a feature amount of the image data registered by theresearch subject registering part and searching for image data that areidentical or similar to the image data being the research subject from aweb site on the network based on the feature amount being calculated andthe research condition; and a search result informing part informing asearch result by the similar image searching part as a research reportto the research client using the terminal apparatus.

The above objects of the present invention are achieved by a serverapparatus for conducting an illegal use research of image data requiringa use permit, the server apparatus including: a research subjectregistering part registering image data received from the researchclient as a research subject to a research subject database for eachresearch client; a research condition setting part setting a researchcondition for research whether or not the image data being registeredare illegally used by a Web site on a network; a similar image searchingpart calculating a feature amount of the mage data registered by theresearch subject registering part, and searching for image data beingidentical or similar to the image data of the research subject based onthe feature amount being calculated and the research condition; and asearch result informing part informing a search result by the similarimage searching part as a research report to the research client.

The above objects of the present invention are achieved by a method forproviding an illegal use research service for image data by a serverapparatus connectable to a client apparatus used by a research clientrequesting the illegal use research for the image data requiring a usepermit through a network, the method including the steps of: registeringimage data received from the client apparatus as research subject to aresearch subject database for each research client; setting a researchcondition for researching whether or not the image data being registeredare illegally used; calculating a feature amount of the image data beingregistered in the registering image data and searching for image databeing identical or similar to the image data of the research subjectbased on the feature amount being calculated and the research condition;and informing a search result as a research subject to the researchclient using the terminal apparatus.

The above objects of the present invention are achieved by a programproduct for causing a computer to function as a system for providing anillegal use research service for image data, the program productincluding the codes for: functioning as a server apparatus forconducting an illegal use research of the image data requiring a usepermit; and functioning as a terminal apparatus used by a researchclient requesting the illegal use research, including the codes forconnecting to the server apparatus through a network, wherein thefunctioning as the server apparatus includes the codes for: registeringthe image data received from the terminal apparatus as a researchsubject to a research subject database for each research client; settinga research condition for research whether or not the image data beingregistered is illegally used by a Web site on the network; calculating afeature amount of the image data registered by registering the imagedata and searching for image data that are identical or similar to theimage data being the research subject from a web site on the networkbased on the feature amount being calculated and the research condition;and informing a search result by the similar image searching part as aresearch report to the research client using the terminal apparatus.

The above objects of the present invention are achieved by a programproduct for causing a computer to function as a server apparatus forconducting an illegal use research of image data requiring a use permit,the program product including the codes for: registering image datareceived from the research client as a research subject to a researchsubject database for each research client; setting a research conditionfor research whether or not the image data being registered areillegally used by a Web site on a network; calculating a feature amountof the mage data registered by the registering image data, and searchingfor image data being identical or similar to the image data of theresearch subject based on the feature amount being calculated and theresearch condition; and informing a search result by the searching as aresearch report to the research client.

The above objects of the present invention are achieved by a programproduct for causing a computer to an illegal use research service forimage data by a server apparatus connectable to a client apparatus usedby a research client requesting the illegal use research for the imagedata requiring a use permit through a network, the program productincluding the codes for: registering image data received from the clientapparatus as research subject to a research subject database for eachresearch client; setting a research condition for researching whether ornot the image data being registered are illegally used; calculating afeature amount of the image data being registered in the registeringimage data and searching for image data being identical or similar tothe image data of the research subject based on the feature amount beingcalculated and the research condition; and informing a search result asa research subject to the research client using the terminal apparatus.

The above objects of the present invention are achieved by acomputer-readable recording medium recorded with a program for causing acomputer to an illegal use research service for image data by a serverapparatus connectable to a client apparatus used by a research clientrequesting the illegal use research for the image data requiring a usepermit through a network, the program including the codes for:registering image data received from the client apparatus as researchsubject to a research subject database for each research client; settinga research condition for researching whether or not the image data beingregistered are illegally used; calculating a feature amount of the imagedata being registered in the registering image data and searching forimage data being identical or similar to the image data of the researchsubject based on the feature amount being calculated and the researchcondition; and informing a search result as a research subject to theresearch client using the terminal apparatus.

The above objects of the present invention are achieved by a system forproviding a proper use research service for image data, the systemincluding: a server apparatus for conducting a proper use research forresearching whether or not image data being permitted to use is properlyused; and a terminal apparatus used by a research client requesting theproper use research, the terminal apparatus connectable to the serverapparatus through a network, wherein the server apparatus includes: aresearch subject registering part registering image data received as aresearch subject from the terminal apparatus and identificationinformation of a Web site managed by a user who received a user permitof the image data for each research client to a research subjectdatabase; a research condition setting part setting a research conditionfor researching whether or not the image data being registered isproperly used at a research subject Web site registering theidentification information; a similar image searching part calculating afeature amount of the image data registered by the research subjectregistering part and searching for image data being identical or similarto the image data being the research subject based on the calculatedfeature amount and the research condition from the research subject Website on the network; and a search result informing part informing asearch result by the similar image searching part as a research reportto the research client using the terminal apparatus.

The above objects of the present invention are achieved by a serverapparatus for conducting a proper use research of image data permittedto use, the server apparatus including: a research subject registeringpart registering image data received from the research client as aresearch subject to a research subject database for each researchclient; a research condition setting part setting a research conditionfor research whether or not the image data being registered are properlyused by a research subject Web site on a network; a similar imagesearching part calculating a feature amount of the mage data registeredby the research subject registering part, and searching for image databeing identical or similar to the image data of the research subjectbased on the feature amount being calculated and the research condition;and a search result informing part informing a search result by thesimilar image searching part as a research report to the researchclient.

The above objects of the present invention are achieved by a method forproviding a proper use research service for image data by a serverapparatus connectable to a client apparatus used by a research clientrequesting the proper use research for the image data permitted to usethrough a network, the method including the steps of: registering imagedata received from the client apparatus as research subject to aresearch subject database for each research client; setting a researchcondition for researching whether or not the image data being registeredare properly used; calculating a feature amount of the image data beingregistered in the registering image data and searching for image databeing identical or similar to the image data of the research subjectbased on the feature amount being calculated and the research condition;and informing a search result as a research subject to the researchclient using the terminal apparatus.

The above objects 6 f the present invention are achieved by a programproduct for causing a computer to function as a system for providing aproper use research service for image data, the program productincluding the codes for: functioning as a server apparatus forconducting a proper use research for researching whether or not imagedata being permitted to use is properly used; and functioning as aterminal apparatus used by a research client requesting the proper useresearch, including the codes for connecting to the server apparatusthrough a network, wherein the functioning as the server apparatusincludes the codes for: registering part registering image data receivedas a research subject from the terminal apparatus and identificationinformation of a Web site managed by a user who received a user permitof the image data for each research client to a research subjectdatabase; setting a research condition for researching whether or notthe image data being registered is properly used at a research subjectWeb site registering the identification information; calculating afeature amount of the image data registered by the research subjectregistering part and searching for image data being identical or similarto the image data being the research subject based on the calculatedfeature amount and the research condition from the research subject Website on the network; and informing a search result by the similar imagesearching part as a research report to the research client using theterminal apparatus.

The above objects of the present invention are achieved by a programproduct for causing a computer to conduct a proper use research of imagedata permitted to use, the program product including the codes for:registering image data received from the research client as a researchsubject to a research subject database for each research client; settinga research condition for research whether or not the image data beingregistered are properly used by a research subject Web site on anetwork; calculating a feature amount of the mage data being registered,and searching for image data being identical or similar to the imagedata of the research subject based on the feature amount beingcalculated and the research condition; and informing a search result bythe similar image searching part as a research report to the researchclient.

The above objects of the present invention are achieved by a programproduct for causing a computer to execute a method for providing aproper use research service for image data by a server apparatusconnectable to a client apparatus used by a research client requestingthe proper use research for the image data permitted to use through anetwork, the program product including the codes for: registering imagedata received from the client apparatus as research subject to aresearch subject database for each research client; setting a researchcondition for researching whether or not the image data being registeredare properly used; calculating a feature amount of the image data beingregistered in the registering image data and searching for image databeing identical or similar to the image data of the research subjectbased on the feature amount being calculated and the research condition;and informing a search result as a research subject to the researchclient using the terminal apparatus.

The above objects of the present invention are achieved by acomputer-readable recording medium recorded with a program for causing acomputer to function as a system for providing a proper use researchservice for image data, the program product including the codes for:functioning as a server apparatus for conducting a proper use researchfor researching whether or not image data being permitted to use isproperly used; and functioning as a terminal apparatus used by aresearch client requesting the proper use research, including the codesfor connecting to the server apparatus through a network, wherein thefunctioning as the server apparatus includes the codes for: registeringpart registering image data received as a research subject from theterminal apparatus and identification information of a Web site managedby a user who received a user permit of the image data for each researchclient to a research subject database; setting a research condition forresearching whether or not the image data being registered is properlyused at a research subject Web site registering the identificationinformation; calculating a feature amount of the image data registeredby the research subject registering part and searching for image databeing identical or similar to the image data being the research subjectbased on the calculated feature amount and the research condition fromthe research subject Web site on the network; and informing a searchresult by the similar image searching part as a research report to theresearch client using the terminal apparatus.

BRIEF DESCRIPTION OF THE DRAWINGS

In the following, embodiments of the present invention will be describedwith reference to the accompanying drawings.

FIG. 1 is a block diagram showing an internal configuration of aninformation processing apparatus according to a first embodiment of thepresent invention;

FIG. 2 is a diagram for explaining a configuration example of theillegal use research service providing system for image data, accordingto the first embodiment of the present invention;

FIG. 3 is a diagram showing an example of the feature amount calculatedby the feature amount calculating part according to the first embodimentof the present invention;

FIG. 4 is a flowchart for explaining an example of a feature amountcalculating process conducted by the feature amount calculating partaccording to the first embodiment of the present invention;

FIG. 5 is a flowchart for explaining an example of an illegal useresearch service providing method for the image data according to thefirst embodiment of the present invention;

FIG. 6 is a diagram for explaining a configuration example of theillegal use research service providing system for the image dataaccording to the first embodiment of the present invention;

FIG. 7 is a diagram for explaining a further system configurationexample of the illegal use research service providing system for theimage data according to the first embodiment of the present invention;

FIG. 8 is a diagram showing a process flow at the search serveraccording to the first embodiment of the present invention;

FIG. 9 is a diagram showing a process flow at the search serveraccording to the first embodiment of the present invention;

FIG. 10A is a diagram showing an example of a client informationmanagement table registering information, which is the research subject,concerning the research client according to the first embodiment of thepresent invention, and FIG. 10B is a diagram showing an example of atrademark information management table registering informationconcerning a trademark according to the first embodiment of the presentinvention;

FIG. 11A is a diagram showing an example of an agreement informationmanagement table for registering information concerning an agreement,according to the first embodiment of the present invention, FIG. 11B isa diagram showing an example of a form management table for registeringinformation concerning contents (message) of the warning e-mail,according to the first embodiment of the present invention, and FIG. 11Cis a diagram showing an example of a similarity degree management tablefor registering information concerning the similarity degree being setto the image data, according to the first embodiment of the presentinvention;

FIG. 12 is a diagram showing an example of a service login screen in theillegal use research service providing system according to the firstembodiment of the present invention;

FIG. 13 is a diagram showing an example of a research condition settingscreen in the illegal use research service providing system according tothe first embodiment of the present invention;

FIG. 14 is a diagram showing an example of a search result displayingscreen in the illegal use research service providing system according tothe first embodiment of the present invention;

FIG. 15A is a diagram showing a state of setting a text example in awarning/attention e-mail creating form according to the first embodimentof the present invention, and FIG. 15B is a diagram showing a state ofadditionally modifying the text example of the warning/attention e-mailcreating form according to the first embodiment of the presentinvention;

FIG. 16 is a diagram showing another example of the search resultdisplaying screen in the illegal use research service providing systemaccording to the first embodiment of the present invention;

FIG. 17 is a diagram showing further example of the search resultdisplaying screen in the illegal use research service providing systemaccording to the first embodiment of the present invention;

FIG. 18 is a diagram showing a configuration example of a proper useresearch service providing system for the image data according to asecond embodiment of the present invention;

FIG. 19 is a flowchart for explaining an example of the proper useresearch service providing method for the image data according to thesecond embodiment of the present invention;

FIG. 20 is a diagram for explaining another configuration example of theproper use research service providing system for the image dataaccording to the second embodiment of the present invention;

FIG. 21 is a diagram for explaining further configuration example of theproper use research service providing system for the image dataaccording to the second embodiment of the present invention;

FIG. 22 is a diagram showing a process flow at the search serveraccording to the second embodiment of the present invention;

FIG. 23 is a diagram showing a process flow at the search serveraccording to the second embodiment of the present invention;

FIG. 24 is a diagram showing an example of an agreement informationmanagement table for registering information concerning an agreement,according to the second embodiment of the present inventions; and

FIG. 25 is a diagram showing an example of a research condition settingscreen in the proper use research service providing system according tothe second embodiment of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENT

FIG. 1 is a block diagram showing an internal configuration example ofan information processing apparatus according to a first embodiment ofthe present invention. In FIG. 1, the information process apparatusincludes a CPU (Central Processing Unit) 1, a RAM (Random Access Memory)2, a ROM (Read-Only Memory) 3, a storage unit 3 such as a hard diskdrive (HDD) or a like, an input unit 5, a display unit 6, acommunication unit 7, an output unit 8, and a system bus 9. A serverapparatus or a terminal unit according to an illegal use researchservice providing system of the present invention can be configuredbased on the information processing apparatus as shown in FIG. 1, thatis, a general computer. Information processed in this system istemporarily accumulated in the RAM 2 at this process, and then, storedin the ROM 3. The CPU 1 reads out, modifies, and writes informationbeing stored if necessary. In addition, a program causing theinformation processing apparatus to function as this system or anapparatus is stored in the ROM 3 or the storage unit 4, and accordinglyread out and executed by the CPU 1. In addition, a process progress anda process result are displayed at the display unit 6 such as a CRT(Cathode Ray Tube), a LCD (Liquid Crystal, and a like to inform a user,and the user inputs necessary parameters by using the input unit 5 suchas a keyboard, a mouse (pointing device), and a like.

In order for the user to easily operate the above-described program whenthe user uses at the display unit 6, the program may include a graphicaluser interface (GUI).

The communication unit 7 communicates with other information processingapparatuses through a network or a like. It should be noted that the CPU1, the RAM 2, the ROM 3, the storage unit 4, the input unit 5, thedisplay unit 6, the communication unit 7, and the output unit 8 areconnected via a system bus 9 and mutually accessible each other.

FIG. 2 is a diagram for explaining a configuration example of theillegal use research service providing system for image data, accordingto the first embodiment of the present invention. In FIG. 2, a serversystem 10 is to provide an illegal use research service, and includes asearch server 11 including a function for searching for a similar image,and a management server 12 including a function for managing informationconcerning a search subject. A member DB (DabaBase) 13 is used toregister member (research client) information. A text example DB(DabaBase) 14 is used to register a text example for various notices tosend by electronic mail. A research subject DB (DabaBase) 15 is used toregister image data or a like subject to research. A research client 20is a user who sends a research request to server system 10 and receivesa research report. Client terminals 211, 212, . . . (hereinafter, oftencalled generally client terminal 211) are computer terminals used by theresearch clients 20. A network 22 is used to communicate to the serversystem 10. A Web site group 30 is a group of Web sites 311, 312, 313, .. . (hereinafter, often called generally Web site 311) on the network22.

The search server 11 includes a similar image searching part 11 a thatcan access the research subject DB 15. The management server 12 includesa research subject registering part 12 a, a research condition settingpart 12 b, and a search result informing part 12 c, which can access themember DB 13, the text example DB 14, and the research subject DB 15.Moreover, the research subject DB 15 registers image data 15 a subjectto the illegal use research, user information 15 b includingidentification information of a Web site managed by a user who receivesa user permit of the image data 15 a, a research condition 15 c, and afeature amount 15 d extracted from the image data 15 a. For example, theidentification information of the Web site included in the userinformation 15 b shows a URL (Uniform Resource Locator) of the Web site.In this embodiment, the server system 10 is configured by these twoservers: the search server 11 and the management server 12.Alternatively, these two servers may be integrated in a single servercomputer. Alternatively, each function included in the server system 10may be distributed to other server computers and terminal units througha network.

In the first embodiment of the illegal use research service providingsystem, the search server 11 and the management server 12 may be accessthe member DB 13, the text example DB 14, and the research subject DB 15through a network or a like. That is, each of the member DB 13, the textexample DB 14, and the research subject DB 15 may be physicallyseparated from the search server 11 or the management server 12.Alternatively, each of the member DB 13, the text example DB 14, and theresearch subject DB 15 may be physically included in the search server11 or the management server 12. Moreover, the search server 11 or themanagement server 12 stores a program for each function of theabove-described parts.

Moreover, the server system 10, the client terminal 211, and the Website 311 are connected through the network 22. Alternatively, a networkbetween the server system 10 and the client terminal 211 may bedifferent from a network between the server system 10 and the Web site311. That is, in a case in that the Internet connected to a dedicatedline being wired or wireless or a phone line is applied to a latternetwork, or in a case in that the Intranet utilizing an Internettechnology or a dedicated line is sued for a former network, the latternetwork and the former network can be a WAN (Wide Area Network) or a MAN(Metropolitan Area Network), or a LAN (Local Area Network) depending ona place where the server system 10 is provided.

The illegal use research service providing system according to thepresent invention includes the search subject registering part 12 a, theresearch condition setting part 12 b, the similar image searching part11 a, the search result informing part 12 c, the member DB 13, the textexample DB 14, and the research subject DB 15. A research request form(including the image data and a research condition) sent from the clientterminal 211 through the network 22 is registered to the researchsubject DB 15 by the management server 12 (the research subjectregistering part 12 a and the research condition setting part 12 b). Thesearch server 11 (the similar image searching part 11 a) searches forthe similar image from a Web site group 30 based on the research requestform being registered. The management server 12 (search resultinformation part 12 c) sends a search result to the client terminal 211.

In the following, the above-described each part will be described indetail.

First, the research subject registering part 12 sets and registers theimage data 15 a subject to a similar search (for example, picture data,design data, trademark data, name, trademark, logo, and a like) for eachresearch client (organization, or a like) to the research subject DB 15.The image data 15 a generally needs a use permit. In a case in that anagreement concerning a use of the image data 15 a (for example, usepolicy or a like) exists, the user information 15 b includinginformation concerning the agreement (for example, a counterparty, a URLof the counterparty, a contact person name, an e-mail (electronic mail)address, a subject image, a use policy, or a like) is also registered tothe research subject DB 15. Moreover, in a case of a new memberregistration, in addition to member (research client) information, theuser information 15 b (a use permit list, an URL that the user manages,the use policy, and the like) may be registered to the member DB 13. Inthis case, the search server 11 may be accessible to the researchsubject DB 15 and the member DB 13, and obtain necessary information fora similar image search.

In a general organization, a trademark application and a registeredtrademark are managed (monitored), and combinations of color, size,letter type, and background, which are permitted to user for atrademark, a name, a logo, and a like of the organization, are regulatedin detail. The user (for example, a associated company, a dealer, abranch, an agent) permitted to use complies with these regulations, andshows a trademark, a name, a logo, and a like of the counterparty to atop page of a related home page (HP), a product, an advertisement, and alike. This use policy is set as an object to manage a uniform brandimage involving the related company. Accordingly, it is possible for therelated company to conduct a use management similarly to a parentcompany. In this case, only users of the related company and the like,which are permitted to use by the agreement, can use the trademark andthe like.

The research condition setting part 12 b sets the research condition 15c for research whether or not the image data 15 a registered by theresearch subject registering part 12 a is illegally used at the Web sitegroup 30 on the network 22. That is, it is researched whether or not anintellectual property (for example, trademark, name, logo, and a like)set by the research client of this system and being subject to thesimilar search is used without notice, and then, the research condition15 c is set to prevent from being misidentified or confused by a similardisplay.

In a case of the illegal use research, in addition to extracting Websites that probably use the intellectually property illegally, theserver system 10 can send an alarm e-mail to a suspected Web site.Moreover, it is possible to indicate “all Web sites” or any type offiles as the research subject. Furthermore, it is possible to extractimage data similar to image data being research subject, and set asimilarity degree based on each feature amount of the similar imagesbeing extracted, and display the similar images being sorted based onthe similarity degree or display the similar images for each category.

Alternatively, the research condition setting part 12 b may set theresearch condition 15 c excluding a Web site registered in the researchsubject DB 15 and managed by the user from subjects of the illegal useresearch. That is, since the Web site (URL) registered in the researchsubject DB 15 is a Web site managed by the user permitted to use, it isconsidered that the illegal use research is not required. Accordingly,it is possible to effectively conduct the illegal use research byexcluding from the subject of the illegal use research predetermined.Moreover, the research condition setting part 12 b can set at least anyone or some of a data format, a data capacity, and a data size of theimage data being a subject of the illegal use research, and also, canset at least any one or some of a domain type, a page type, and a pagelayer of the Web site being the subject of the illegal use research.Moreover, the research condition setting part 12 b sets and register, asthe research condition 15 c, a research range (the entire or a part ofWeb or a like), a research schedule (for example, a research iscontinuously conducted once per day for 6 months, or the like), aresearch result (for example, the warning e-mail is sent or not, or thelike), and a country or a region being a research subject (such asAmerica, China, Europe, or the like).

Furthermore, the research condition 15 c will be described in detail.

The research condition 15 c is a set of various conditions for improvinga search effect by limiting a search range and it is possible to set thefollowing items specifically. Moreover, since the research condition 15c is set in detail to limit the search range, it is possible to reduce aworkload of this system and to adjust (discount) a cost of the research.

(1) subject period: this is a term for limiting time to research a testresearch subject image over pages including the research subject imageon a published Web. For example, by limiting time to research, it is notrequired to trace back to a time before the research subject image wascreated or published, and it is possible to improve the search effect. Aservice user is not considered even if the service user used theresearch subject image before this subject period.

(2) research cycle: in a case of repeatedly researching periodically tomonitor an illegal use, a cycle to monitor is set.

(3) type of test research subject image: a type of the test researchsubject image, for example, “photograph”, “logo”, “trademark”,“illustration”, “painting”, or a like is indicated. By this indication,each search parameter (weight of feature amount) proper for each searchsubject is set. In a case in that this condition is not set (notindicated), an image registered as the research subject can beautomatically determined, and the search parameter can be automaticallydetermined. As described above, both a manual setting and an automaticsetting can be conducted. For example, even if the research subjectimage is “photograph” and the research subject image is processed tomodify to another type of an image and is illegally used, it is possibleto identify the research subject image.

(4) color of main element: this is set to show whether or not thefeature amount concerning “color” of research subject image and the testresearch subject. In a case in that a logo or a graphic trademark isillegally used, as a purpose for a third person to misidentify the logoor the graphic trademark, it is predicted to change the research subjectimage into a different image. For example, in a case in that the featureamount of the test research subject image other than features related to“color” shows a higher similarity degree but the feature amountconcerning “color” shows quite dissimilar to the research subject image,the test research subject image can be highly concerned as an imagebeing illegally used. By setting a detection parameter so as to includethe feature amount concerning this “color”, it is possible to detect theimage being illegally used in this case.

(5) data format of test research subject: this is indicated to limitdata formats (for example, JPG, GIF, PNG, BMP, or a like) of the testresearch subject. For example, in a case in that the research subjectimage is a photographic image of the JPG format, when converting intothe GIF format, an image quality is degraded. In a case of overlookingan unauthorized use of a degraded image, by setting a different dataformat from the research subject image as the test research subject, itis possible to narrow the research range and improve the researcheffect. Moreover, if an image format that a Web browser can display isconsidered, the data format is limited to any one of the above fourtypes. However, a TIFF format cannot be displayed at the Web browser butcan be placed on the Internet to make it possible to download. If thiscase suffers a loss for an owner of the research subject image, the dataformat such as the TIFF format or the like which suffers a loss can beindicated.

(6) data capacity of test research subject image: this is set to limitthe data capacity of the test research subject image. Similar to thedata format of the test research subject image above item (5), if thedata capacity is greatly changed from the research subject image, thetest research subject image is considered to be different from anoriginal. Accordingly, it is limited so that an image having the datacapacity greatly different from the original is not considered as theresearch subject. Therefore, it is possible to further improve thesearch effect by this setting.

(7) domain type: a domain type subject to research is set. This is setto roughly limit forms of a research subject country and a researchsubject organization. For example, when an organization planning toexpand its business to overseas researches a trademark similar to thatof the organization beforehand, a domain other than JP domain may beindicated.

(8) page type: since generally, a Web site of an organization or a likeincludes a plurality of regular pages of “top page”, “corporateprofile”, “What's New”, or a like, a page type can be specified by usingan analyzing technique of the Web site. Accordingly, it is possible toimprove the search effect. For example, in a case in that a company logoof a company A as the research client is placed on “top page” of a homepage of a company B having no relation to the company A, the company Bprobably introduces the company A or a product of the company A simply.Thus, a disbenefit degree to the company A is different at the pagetype. It is possible to consider the disbenefit degree based on the pagetype by setting the page type.

(9) page layer: this is indicated to limit a depth of the page layerfrom “top page” of the Web site begin the test research subject. Similarto the above (8) page type, the disbenefit degree is different dependingon the page layer within the Web site. Accordingly, for example, byexcluding pages placing on an extremely deeper layer, it is possible toimprove the research effect.

The illegal use research is conducted under the above-described researchcondition 15 c, that is, by properly combining the above (1) through(9). In this case, in response to the settings of the research condition15 c, an estimate calculating part (described later) is executed. Then,a research cost is estimated, and displayed. Alternatively, by inputtinga budget for this research, the type of the research subject may beautomatically determined, and a standard research condition may beautomatically determined in response to the budget input by the researchclient.

The similar image searching part 11 a of the search server 11 includes apart for calculating the feature amount 15 d of the image data 15 aregistered by the research subject registering part 12 a. The featureamount 15 d calculated by this feature amount calculating part isregistered with the image data 15 a to the research subject DB 15. Thesimilar image searching part 11 a can extract the feature amount 15 dfrom any one or some of a color, a pattern, a shape, and a layout of theimage data 15 a as the subject of the illegal use research. The similarimage searching part 11 a searches for image data identifying orresembling the image data 15 a based on the research condition 15 c andthe feature amount 15 d of the image data 15 a set by the researchcondition setting part 12 b from the Web site group 30.

FIG. 3 is a diagram showing an example of the feature amount calculatedby the feature amount calculating part according to the first embodimentof the present invention.

As shown in FIG. 3, the similar image searching part 11 a automaticallyextracts and digitalizes a coloration of the entire image, adistribution of color, a composition (distribution of a texture and anedge), a pattern (texture), and a like at an image registration by thefeature amount calculating part. Different from a search functionutilizing a date, a keyword, a file name, and a like, the similar imagesearching part 11 a searches for image by applying concepts such as thecoloration (checks the number of pixels for each color to set as thefeature amount), the distribution of color (defines a representativecolor extracted from each portion of the image as the feature amount),the composition (defines an edge extracted from each portion of theimage), and the pattern (analyzes and defines a brightness change foreach pixel as the feature amount), which are difficult to express byusing character data.

The feature amount can be broadly categorized into four types, that is,a color system, an edge system, a shape system, and a pattern system.

1. Color System

(a) color histogram: this is characterized by a composition and anamount of all colors.

(b) main color: this is characterized by a main color composing theimage.

(c) coloration: this is characterized by a color location (locationinformation) in the image.

2. Edge System

(a) characterized by an edge amount and an angel distribution includedin the image.

(b) characterized by an edge amount, an angle distribution, and locationinformation.

3. Shape System

(a) curvature: characterized by a curved degree of an outer shape.

(b) characterized by an oblateness and a moment of an object.

4. Pattern System

(a) characterized by a distribution of a change amount of a tint.

(b) characterized by a distribution and location information of a changeamount of a tint.

(c) characterized by a frequency characteristic obtained by the Fouriertransform and the wavelet transform.

It should be noted that the feature amount including the locationinformation in each explanation of the feature amount indicates afeature according to a shape.

In the following, characteristics of parameters and types of theresearch subject image will be described.

First, in most the graphic trademarks, since a color is irrelevant, aweight of the feature amount of “color system” is set to be lower and aweight of each feature amount of “edge system” and “shape system” is setto be higher so that the research is conducted effectively. Also, in acase of the graphic trademark, since there is less informationconcerning refined pattern and texture, a weight of the feature amountof “pattern system” may be set to be lower.

Different from the graphic trademark, a company logo and a companyillustration often include color information and there is a case in thatan image being a different color (identical shape but different color)is recognized as the same one. Accordingly, a weight of the featureamount of “color system” is changed to be higher or lower. In addition,since similar to the graphic trademark, there is less informationconcerning the refined pattern and texture for the company logo andillustration, a weight of the feature of “pattern system” may be set tobe lower.

In an image and a painting such as works, since the entire image(including a background) has a meaning, all feature amounts describedabove are effective.

Furthermore, in photographic images of a person having a portrait rightand a product, the features amounts of “color system”, “shape system”,and “pattern system” are effective. Regardless to the background,clothes, a light state at a time of taking a photograph, it is necessaryto specify the person or the product within the image at higherpriority. Accordingly, it is required to conduct a pre-process such as aprocess for separating the background before extracting the featureamount. In this system according to the present invention, thepre-process may be conducted. Also, in a case in that a photograph of atextile product or a like is the search subject, it is preferable to setthe weight of the feature of “pattern system” to be higher, so that theresearch becomes effective.

FIG. 4 is a flowchart for explaining an example of a feature amountcalculating process conducted by the feature amount calculating partaccording to the first embodiment of the present invention.

First, the search server 11 receives “network path” or “URL” where theimage subject to register (called registration subject image) exists,and determines that the registration subject image is indicated when“network path” or “URL” being received is indicated (step S1).

In a method for indicating a registered image by a registration client,an image may be uploaded one by one or a plurality of images may belisted and uploaded. Alternatively, a directory indicating a locationwhere the image is stored may be indicated or a directory list may beuploaded.

Next, the search server 11 obtains the registration subject image basedon a indicated “network path” or “URL” (step S2), and normalizes thesize (the number of pixels, an aspect ratio, and a like) of theregistration subject image (step S3). Next, when the feature amount isextracted from the registration subject image being normalized and thereare a plurality of patterns of feature amount (for example, the colorsystem, the edge system, the shape system, and the pattern system), inresponse to a requested condition, the entire or necessary patterns arespecified and an execution order for the patterns is determined, and thefeature amount is calculated in response to its result (step S4). In acase in that a plurality of patterns for the feature amount aredetermined, the plurality of patterns are accordingly combined and eachfeature amount is calculated.

Next, the (search server 11 registers input information that isreceived, a calculated pattern of the feature amount, and thecalculation result to the research subject DB 15 by associating witheach other (step S5). Subsequently, the search server 11 determineswhether or not all images are registered (step S6). When all images areregistered (YES), the search server 11 terminates the feature amountcalculating process. On the other hand, when all images are notregistered (NO), the search server 11 goes back to the step S4 to repeatthe above-described steps.

Moreover, a detail process for searching a similar image can be realizedin accordance with, for example, a method disclosed in JapaneseLaid-open Patent Application No. 2002-245045 or other method beingpublished, and a detail explanation thereof will be omitted.

Furthermore, when the similar image searching part 11 a according to thefirst embodiment of the present invention searches for image data beingidentical or similar to the image data 15 a, the similar image searchingpart 11 a sets a predetermined range to the feature amount 15 d of theimage data 15 a registered research subject DB 15, searches for imagedata including the feature amount within the predetermined range fromthe Web site group 30 on the network 22 as the similar image, andobtains the image data searched for as the similar image and a URL ofthe Web site including the image data.

By setting the predetermined range, a threshold is set to determine arange of the feature amount for recognizing similar image data. Forexample, a threshold is set for each feature amount of the researchsubject image, and the test research subject image is determined as asimilar image if the feature amount of the test research subject imageis within the threshold. Accordingly, since the threshold is set foreach feature amount, it is possible to confirm a similarity degree withrespect to an arbitrary feature amount. In addition, a predeterminedrange, that is, a threshold may be defined with respect to thesimilarity degree, which will be described. In this case, it isdetermined whether or not the similarity degree calculated based on thefeature amount of the test research subject image is within a threshold.When the feature amount of the test research subject image is within thethreshold, it is determined that the test research subject image issimilar to the research subject image. Therefore, it is possible toconfirm the similarity degree in a view of the entire image.

In this system, by setting the above-described thresholds, it ispossible to adjust each weight by using a combination of a plurality ofthe feature amount such as “color system”, “edge system”, “shapesystem”, and “pattern system”. In a case of adjusting the weight of eachfeature amount, since this system processes various types of images asthe search subject, search accuracy is improved by adjusting the weightof each feature amount by the image type.

The graphic trademark is basically irrelevant to color but mainly theshape of the graphic trademark and a meaning of the shape are important.Accordingly, since the feature amount related to color is lessimportant, the weight of the feature amount related to color ispreferably set to be lower or no effect.

Different from the graphic trademark, the company logo and illustrationinclude color information but do not have fine pattern information suchas a photograph or a CG (Computer Graphics). Accordingly, the weight ofthe feature amount related to the pattern is preferably set to be lower,so that the search effect can be improved.

Since for a product picture and a portrait, the feature amounts of acolor, a shape, and a pattern of the product and the person areimportant but a background is less important, the feature amount of aregion representing the image is preferably considered more than thecolor, the pattern, and location information, so as to effectivelyimprove the search accuracy.

For the painting and the graphic as works, all feature amounts over theentire painting and graphic are effective.

The search result informing part 12 c displays a search result by thesimilar image searching part 11 a as a research report at the clientterminal 211 to inform the search result to the research client. In thiscase, the entire or a part of a text being informed may be registered asa template in the text example DB 14 beforehand. Moreover, the imagedata, which are searched, may be displayed with the text based on apredetermined classification. Alternatively, the image data, which aresearched, may be displayed all together at a special screen.

As the search result, in the research report, regarding to an imagerecognized as a similar and illegally used image, the image itself isdisplayed and also, a URL of the image, an image file name, a URL of aWeb site showing the image, a domain type of the Web site (jp, com, de,or a like), a Web site showing the image (layout image: an appearanceand a location of the image in a page), a similarity degree (0 through100%), an image size (dot, pixel, or a like), an image file capacity(KB), a search subject period (start date and end date to associate withthe research cycle), an area tendency, a falsification tendency, aseriousness degree, and a like are displayed.

As the area tendency, a country name where the Web site belongs isdetermined by the domain type and a written language of the Web site, orcontents described by a site administrator, and then, the researchreport shows a country having a greater degree of illegally using theresearch subject image. The country may be plotted on a world map todisplay. In addition, it is possible to report a tendency of the domaintype to show that the research subject image is often illegally usedmore in organizations (co.jp) or educational institutions (ac.jp) in thesame country (Japan).

A person trying the illegal use may falsify an original (researchsubject) image to be a different image. It can be a purpose tomisidentify as the original image. Thus, the person may falsify a partof various feature amounts of the images. For example, in a case ofchanging only color of a logo or a background of the logo, otherfeatures such as a shape, a pattern, or a like are quite similar to theoriginal image but only the feature amount of color is quite differentfrom the original image. As described above, the falsification tendencyreports a tendency of a specific feature of the features (color, shape,pattern, or the like), which is most falsified.

As described above, similar to the falsification tendency, in a case inthat most features are quite similar to the original data but thesimilarity degrees of one or a few features of the image are lower, theimage is determined as a falsified image. The lower the similaritydegrees of one or the few features of the image, the greater thefalsification degree. That is, it is considered that the greater thefalsification degree, the higher the seriousness degree.

In a case in that an image identical or similar to the research subjectimage (and unauthorized as a service user) is displayed on a top page ofa Web site, it is considered that this case intentionally aims that athird person misidentifies as a Web site managed by the service user. Onthe other hand, in a case in that the image identical or similar to theresearch subject image is displayed at a link page linking to a relatedcompany or dealer company, it is considered that this case does notintentionally aim that the third person misidentifies as the Web sitemanaged by the service user. Thus, it is possible to estimate theseriousness degree based on the page type. In this system, it ispossible to determine and report the page layer, the page type, thelocation in the page (if displayed in a header, it highly aims for thethird person to be misidentified) displaying the image in the Web siteby a Web site analyzing method.

Identification information of the Web site includes the domain name/URL,the domain type, and the above-described Web site analyzing method. Asthe domain name/URL, the domain name or the URL of the Web siteexcluding an organization and a related organization of the researchclient from the research subject can be registered as a list.

The domain type can limit a research subject country by the domain typesuch as jp=Japan, ge=Germany, cn=China, or a like. Moreover, the Website analyzing method can specify a page layer by clearly determining alayer structure by a Web site transition analysis being based onhyperlink information such as a html tag.

The similar image searching part 11 a can set the similarity degreebased on the feature amount of the image data obtained as the similarimage. The search result informing part 12 c may sort the image data inan order of higher similarity degree set by the similar image searchingpart 11 a, and display the image data being sorted with informationincluding at least the identification information (such as the URL) ofthe Web site including the image data and the similarity degree of theimage data, when the search result is display to inform the researchclient at the client terminal 211. In addition, the search resultinforming part 12 c may individually display the image data havinghigher similarity degree with detail information based on the similaritydegree, individually display the image data having a middle level of thesimilarity degree without the detail information, and display only imagedata having lower similarity degree at the same screen, as a display(informing) method.

The similarity degree shows a distance of the feature amounts (that is,distance between the research subject image and the test researchsubject) by a percentage in a case of using each feature amount as asingle measurement. The similarity degree shows a distance of a weightedaverage of each feature amount by a percentage in a case of using aplurality of the feature amounts (in this embodiment, such as the color,the edge, the pattern, and the shape). This calculation is described asfollows:

similarity degreed=K(color)×d(color)+K(edge)×d(edge)+K(pattern)×d(pattern)+K(shape)×d(shape)  (1)

In this calculation (1), K denotes a weight coefficient for each featureamount, and d denotes a value calculated as a distance between theresearch subject image and the test research subject image for eachfeature amount.

A user may determine that 100% of the similarity degree shows quitesimilar to the original image and 0% of the similarity degree shows notsimilar to the original image. However, in this system, this calculationresult is determined as a difference degree. Accordingly, the differencedegree 0% corresponds to the similarity degree 100%, and there is nodistance between the research subject image and the test researchsubject image, that is, the difference degree 0% is determined as quitesimilar to the original image. The difference degree 100% corresponds tothe similarity degree 0%, and there is a quite far distance between theresearch subject image and the test research subject image, that is, thedifference degree 100% is determined as not similar to the originalimage.

The similarity image searching part 11 a calculates the feature amountand the distance of the research subject image with respect to eachfeature amount of the test research subject. This calculation isconducted for all test research subject images. By using the abovecalculation (1), the similarity degree is calculated for each testresearch subject image. In addition, the similarity degree is picked upwhen the similarity degree as a result of the calculation is within therange being set beforehand.

The threshold for the similarity degree can be set corresponding to apurpose. For example, in a case in that the purpose is to send a warninge-mail to the Web site illegally using the research subject image, thatis, the purpose is to send the warning e-mail showing the illegal use atthe Web site based on search (research) subject list, the threshold isset to be higher so as to determine an image as a subject having thesimilarity degree being higher than a certain degree, and the warninge-mail is sent after the user confirms that the Web site definitely usesthe research subject image illegally. In addition, the falsificationtendency and the seriousness degree, which are shown in the researchreport, can be included to determine the illegal use.

In a case in that the purpose is to warn the Web site possible toillegally use the research subject image, that is, the purpose is tosend an e-mail to the Web site, which displays the image similar to theresearch subject image and is not the search subject, in order to callattention to a possibility of using the research subject image without apermission, the threshold is set to be the middle level, and an imagehaving the similarity degree being higher than a certain degree is asubject. If the user of this system intends to send an attention e-mailwithout a confirmation step of a user side, the confirmation step isomitted and the attention e-mail is sent to the Web site. When the abovepurpose is to indicate a proper use method, that is, the purpose is tosend e-mail confirming whether or not the image is used properly, to agroup organization with the permission to use the research subjectimage, a Web page describing a use regulation of an organization logo ora like is prepared beforehand, and a URL of the Web page is send bye-mail so as to confirm the proper use periodically.

The text example DB 14 records each text example of the warning e-mailincluding different contents corresponding to the similarity degreebeing set for each image data. In this case, the test example for thewarning e-mail may be recorded in each language so as to correspond to aWeb site in each country.

The search result informing part 12 c includes a part for sending thewarning e-mail to the Web site including the similar image searched bythe similar image searching part 11 a. When the search result informingpart 12 c sends the warning e-mail to the Web site 311 including thesimilar image, the search result informing part 12 c may select the textexample corresponding to the similarity degree of the similar image fromthe text example DB 14, set the selected text example to the warninge-mail, and send the warning e-mail including the selected text examplefrom the text example DB 14 to an e-mail address shown in the Web site311. Alternatively, the search result informing part 12 c may send thewarning e-mail including the selected text example to the clientterminal 211 before sending the warning e-mail to the e-mail addressshown in the Web site 311, and send the warning e-mail to the e-mailaddress shown in the Web site 311 after the research client confirms ormodifies the warning e-mail.

FIG. 5 is a flowchart for explaining an example of an illegal useresearch service providing method for the image data according to thefirst embodiment of the present invention. In FIG. 5, the illegal useresearch service providing method will be described based on the illegaluse research service providing system shown in FIG. 2. The managementserver 12 determines whether or not the research client is newlyregistered when the management server 12 receives a research requestfrom the client terminal 211 through the network 22 (step S11). When theresearch client is newly registered (YES), the management server 12receives member registration information (for example, memberinformation, a user permit list, a use regulation, or a like) (stepS12), registers the member registration information to the member DB 13(step S13), issues a user ID and a PWD (password) after thisregistration ends (step S14), and advances to step S15.

On the other hand, when the research client is not newly registered instep S11, that is, the research client has been already registered (NO),the management server 12 selects an input of the user ID and the PWD anda research purpose (step S15). In this case, the management server 12checks whether or not the user ID and the PWD input by the researchclient (step S16). When the user ID and the PWD are not correct (NO),the management server 12 displays an error at the client terminal 211(step S17), and determines whether or not the user ID and the passwordare input again by the research client (step S18). When the user ID andthe password are input again (YES), the management server 12 goes backto the step S15 to repeat the above steps. On the other hand, when theuser ID and the password are input again (NO), the management server 12terminates the illegal use research service providing method.

Next, when the user ID and the PWD are authenticated (step S16), theresearch client determines whether or not the research purpose is theillegal use research (step S19). When the research client indicates aresearch other than the illegal use research (for example, a similardesign research or a like) (NO), the research is conducted (step S20).In the step S19, when the research purpose is the illegal use research(YES), the illegal use research concerning the image data is conducted(step S21). The management server 12 registers the image data 15 a andthe research condition 15 c for the research subject to the researchsubject DB 15 (step S22). The search server 11 calculates the featureamount 15 d from the image data 51 a registered in the research subjectDB 15 (step S23), and searches for the similar image included in the Website group 30 based on the feature amount 15 d being calculated and theresearch condition 15 c (step S24).

Next, the search server 11 sets the similarity degree based on thefeature amount with respect to the similar image searched in the stepS24 (step S25), and the management server 12 sends the research reportincluding at least the similar image and image information including thesimilarity degree of the similar image to the research client (clientterminal 211) (step S26). Next, the management server 12 determines(based on the user selection) whether or not to send the warning e-mailto the Web site displaying the similar image (step S27). When thewarning e-mail is sent to the Web site (YES), the management server 12generates the warning e-mail corresponding to the similarity degree, anddistributes the warning e-mail to the Web site (step S28).

Next, the management server 12 determines whether or not to conduct thesimilar search periodically based on the research condition 15 c of theresearch subject DB 15 (step S29). When the similar search is conductedperiodically (YES), the illegal use service providing method advances tothe step S24 and searches for the similar image from the Web site group30 at predetermined intervals defined beforehand. On the other hand, inthe step S29, when the similar search is not conducted periodically, forexample, the similar search is temporarily conducted (NO), the illegaluse research service providing method is terminated. In the step S27,when the warning e-mail is not sent to the Web site (NO), the illegaluse research service providing method advances to the step S29.

FIG. 6 is a diagram for explaining a configuration example of theillegal use research service providing system for the image dataaccording to the first embodiment of the present invention. The serversystem 10 includes the search server 11 and the management server 12,and includes the member DB 13, the text example DB 14, the researchsubject DB 15, and the feature amount DB 16. In addition, the searchserver 11 includes the similar image searching part 11 a, and thefeature amount registering part 11 b, and can access the researchsubject DB 15 and the feature amount DB 16. The management server 12includes the research subject registering part 12 a, the researchcondition setting part 12 b, the search result informing part 12 c, andthe estimate amount calculating part 12 d, and can access the member DB13, the text example DB 14, and the research subject DB 15. In thissystem configuration, different from the system configuration shown inFIG. 2, the illegal use research service providing system according tothe first embodiment of the present invention includes the featureamount registering part 11 b, the estimate amount calculating part 12 d,and the feature amount DB 16. The other parts are the same as the partsin the system configuration shown in FIG. 2, and the explanation thereofwill be omitted.

The feature amount registering part 11 b of search server 11 calculatesthe feature amount from the image data including the Web site bysearching for the Web site group 30 periodically on the network 22, andregisters the calculated feature amount to the feature amount DB 16 byassociating the calculated feature amount with the URL of each Web site.In the server system 10 according to the first embodiment of the presentinvention, a search of the similar image is conducted by comparing thefeature amount 15 d of the image data 15 a registered in the researchsubject DB 15 with the feature amount registered in the feature amountDB 16. That is, the similar image searching part 11 a sets apredetermined range to the feature amount 15 d of the image data 15 aregistered in the research subject DB 15 and searches for the featureamount being within the predetermined range from the feature amountregistered in the feature amount DB 16 when the similar image searchingpart 11 a searches for the image data which is identical or similar tothe image data 15 a as the research subject image. As a result thesimilar image searching part 11 a obtains the searched image datacorresponding to the feature amount and the URL of the Web siteincluding the searched image data.

The estimate amount calculating part 12 d calculates an approximateestimate for an expense of the illegal use research based on theresearch condition 15 c set by the research condition setting part 12 b.The management server 12 may inform the estimate amount calculated bythe estimate amount calculating part 12 d before searching for thesimilar image by the similar image searching part 11 a, and execute thesimilar image search when the research client approves the estimateamount. Alternatively, a budget range (upper limit of the expense) ofthe research client may be set, and the similar image search isconducted within this budget range.

A detailed embodiment of the estimate amount calculating part 12 d willbe described in the following:

(1) reduce the estimate amount each time the research condition 15 c.

By setting the research condition 15 c in detail, the research range islimited. Accordingly, since a workload to this system is reduced, theexpense for the illegal use research service is reduced.

(2) charge corresponding to the number of the attention e-mails and thewarning e-mails, or an automation degree.

It is possible to set to automatically distribute the attention text orthe warning text prepared beforehand with respect to a mail address ofan administrator or a contact person of the Web site, which isdetermined as the Web site illegally using the research subject imagebased on the research result. This system includes a function forautomatically generating this attention text or this warning text andcan provide a step for editing the text automatically generated.Alternatively, the attention or warning e-mail may not be set. Theexpense can be calculated by corresponding to these setting contents.

(3) no charge for the similar image search.

For example, the research (search) may be generally open to any researchclient by free, and a list of the test research subject images havinghigher similarity degree may be displayed as the research result.However, information such as the URL of the Web site including the imagebeing searched cannot be displayed unless the research client tends topay a service expense. Since the service user can apply to a chargedservice after a service user confirms that a preferable research resultcan be obtained, a satisfaction degree of the service user can behigher. In a case in that the research subject can be narrowed or a listregistration of the domain name and the URL to exclude the researchsubject, a user registration is required and only charged service isrequired to apply. However, a condition setting can be free.

The research subject registering part 12 a may register a researchhistory concerning the image data for each research client with theimage data subject to the illegal use research to the research subjectDB 15. In this case, the research subject registering part 12 a mayregister the number of sending the warning e-mail by the search resultinforming part 12 c as the research history registered in the researchsubject DB 15 for each Web site including the similar image searched bythe similar image searching part 11 a. Moreover, the search resultinforming part 12 c may change a warning content of the warning e-mailgradually (for example, an attention content until four times and thewarning content after more than four times) by corresponding to thenumber of sending the warning e-mail registered by the research subjectregistering part 12 a.

According to the first embodiment of the present invention, the similarimage search can be realized by a simple system configuration.Therefore, it is possible to conduct the illegal use researcheffectively and at a lower expense. Moreover, since the similar imagesearch can be realized for various image data, it is possible to applythe similar image search for a wider purpose. Furthermore, since it ispossible to research the Web site possible to infringe a copy rightbased on the similar image, it is possible to trace and research the Website even if a site administrator infringing the copy right withmalicious intent closes the Web site and open the Web site by anotherURL.

FIG. 7 is a diagram for explaining a further system configurationexample of the illegal use research service providing system for theimage data according to the first embodiment of the present invention.In FIG. 7, the illegal use research service providing system includesthe search server 11 and the management server 12 but differentorganizations independently manage and operate the search server 11 andthe management server 12, respectively. The search server 11 includesthe similar image searching part 11 a, the feature amount registeringpart 11 b, an application service providing part 11 c, and a chargingpart 11 d, and can access the feature amount DB 16 and/or the researchsubject DB 15. The management server 12 includes the research subjectregistering part 12 a, the research condition setting part 12 b, thesearch result informing part 12 c and the estimate amount calculatingpart 12 d, and can access the member DB 13, the text example DB 14, andthe research subject DB 15.

As shown in FIG. 7, in the present invention, the image searchingfunction included in the search server 11 can be applied to an ASP(Application Service Provider) system in which the image searchingfunction can be provided through the network as an application. In thiscase, the application service providing part 11 c of the search server11 included in an ASP service provider provides various services asapplications through the network to provide various parts (the similarimage searching part 11 a and/or the feature amount registering part 11b) included in the search server 11, to the management server 12 as aservice receiver. Moreover, the charging part 11 d charges for a serviceprovided by the application service providing part 11 c. A chargingmethod by the charging part 11 d may determine a charged amount bycorresponding to the research condition (or the research result) such asa frequency of the similar search, the search range, the number of setsof image data as the search subject, the number of search hits, or thelike. Alternatively, the charging method may determine the chargedamount based on a fixed rate by a predetermined unit such as monthly,daily, a search unit, or a like.

FIG. 8 and FIG. 9 are flowcharts for explaining another illegal useresearch service providing method for the image data according to thefirst embodiment of the present invention. FIG. 8 is a diagram showing aprocess flow at the search server according to the first embodiment ofthe present invention. FIG. 9 is a diagram showing a process flow at thesearch server according to the first embodiment of the presentinvention. This illegal use research service providing method will bedescribed based on the illegal use research service providing system inFIG. 6.

In FIG. 8, first, the management server 12 determines whether or not theresearch client is newly registered when accepting the research requestfrom the client terminal 211 through the network 22 (step S31). When theresearch client is newly registered (YES), the management server 12receives the member registration information (for example, the memberinformation, the user permit list, the user regulation, and the like)input by the research client (step S32), and registers the memberregistration information to the member DB 13 (step S35). After thisregistration ends, the management server 12 issues the user ID and PWD(password) (step S34), and advances to step S35.

In the step S31, when the research client is not newly registered, thatis, the research client has been already registered (NO), the managementserver 12 selects an input of the user ID and PWD or the researchpurpose (step S35). In this case, the management server 12 checkswhether or not the user ID and PWD input by the research client iscorrect (step S36). When the user ID and PWD are not correct (NO), themanagement server 12 displays an error at the client terminal 211 (stepS37), and checks whether or not the user ID and PWD are input again (bythe research client) (step S38). When the user ID and PWD are inputagain (YES), the management server 12 goes back to the step S35 torepeat the above-described steps. On the other hand, when the user IDand PWD are not input again (NO), the illegal use research serviceproviding method is terminated.

Next, when the user ID and PWD are authenticated in the step S36, it ischecked (by the research client) whether or not the research purpose isthe illegal use research (step S39). When the research purpose is aresearch (for example, the similar design research or the like) otherthan the illegal research (NO), the research is conducted (step S40). Inthe step S39, when the research purpose is the illegal use research(YES), the illegal use research concerning the image data is conducted(step S40). The management server 12 registers the image data 15 a asthe research subject image and the research condition 15 c to theresearch subject DB 15 (step S42), and requests the similar image searchto the search server 11 (step S43). In this case, the management server12 may request with the image data 15 a being the research subject imageto the search server 11.

In FIG. 9, the search server 11 calculates the feature amount 15 d fromthe image data 15 a registered in the research subject DB 15 (step S44),and searches for the similar image by matching with the feature amountregistered in the feature amount DB 16 based on the feature amount 15 dbeing calculated and the research condition 15 c (step S45). Next, thesearch server 11 sets the similarity degree based on the feature amountwith respect to the similar image being searched (step S46), and informsthe search result including at least the similar image and imageinformation including the similarity degree of the similarity image tothe management server 12 (step S47).

In FIG. 8, the management server 12 sends the research report based onthe search result informed from the search server 11 to the researchclient (client terminal 211) step S48). Next, the management server 12determines whether or not to send the warning e-mail to the Web sitedisplaying the similar image (step S49). When the warning e-mail is sentto the Web site (YES), the management server 12 generates the warninge-mail corresponding to the similarity degree, and distributes thewarning e-mail to the Web site (step S50).

Next, the management server 12 determines whether or not the similarsearch is conducted periodically, based on the research condition 15 cregistered in the research subject DB 15 (step S51). When the similarsearch is conducted periodically (YES), the management server advancesto step S52.

In FIG. 9, the search server 11 circulates the Web sites included in theWeb site group 30 on the network 22 (step S52), searches for the imagedata from each Web site being circulated (step S53), calculates thefeature amount of the image data being searched for (step S54), andregisters the feature amount being calculated to the feature amount DB16 (step S55). The feature amount DB 16 is referred to by the searchserver 11 in the step S 45.

In the step S52 in FIG. 8, when the similar search is not conductedperiodically, for example, the similar search is temporarily conducted(NO), the illegal use research service providing method is terminated.In the step S49, when the warning e-mail is not sent to the Web site(NO), the illegal use research service providing method advances to thestep S51.

Next, data tables registered by the server system 10 will be described.FIG. 10A is a diagram showing an example of a client informationmanagement table registering information, which is the research subject,concerning the research client according to the first embodiment of thepresent invention. FIG. 10B is a diagram showing an example of atrademark information management table registering informationconcerning a trademark according to the first embodiment of the presentinvention. In FIG. 10A, in the client information management table, forexample, items such as a research client name (user organization name),a registered date, trademark information (shown by an identificationnumber), agreement information (shown by an identification number),valid term, image information (shown by an identification number), anURL, report information, previous research date, and a like areregistered. In FIG. 10B, in the trademark information management table,for example, items such as a trademark, a pronunciation, a category, animage size, a letter type, color, a pattern, a data type, an attachment(for example, a HP, a catalog, a manual, or a like), and a like areregistered.

FIG. 11A is a diagram showing an example of an agreement informationmanagement table for registering information concerning an agreement,according to the first embodiment of the present invention. FIG. 11B isa diagram showing an example of a form management table for registeringinformation concerning contents (message) of the warning e-mail,according to the first embodiment of the present invention. FIG. 11C isa diagram showing an example of a similarity degree management table forregistering information concerning the similarity degree being set tothe image data, according to the first embodiment of the presentinvention.

In FIG. 11A, the agreement information management table, for eachcompany name contracting the use agreement of the trademark (that is,company name that received the user permit of the trademark), forexample, items of a registered date, trademark information, agreementinformation, valid term, a URL, and a like are registered. Moreover, inFIG. 11B, for example, in the form management table, a form name (forexample, a warning form, an advisory form, or a like), a registereddate, a form type (template) (shown by an identification number), asimilarity degree of the image data (A, B, . . . ), a valid term, and alike are registered. Furthermore, in FIG. 11C, in the similarity degreemanagement table, for each similarity degree of the image data, forexample, a form type (template) (shown by an identification number), avalid term, a display method (for example, a detail display, a simpledisplay, or a like), and a like are registered.

FIG. 12 is a diagram showing an example of a service login screen in theillegal use research service providing system according to the firstembodiment of the present invention. In FIG. 12, the service loginscreen 40 includes a member registration page link 41, a member ID andpassword input area 42, a research purpose selection area 43, and aresearch detail setting page link 44. In a case of a new memberregistration, the research client using this service accesses a memberregistration page from the member registration page link 41 to conductthe member registration. In a case in that the research client is amember, the research client inputs his/her member ID and password to themember ID and password input area 42. Subsequently, the research clientselects a desired course from the research purpose selection area 43(such as illegal use research, a proper use research, a design research,or a like), and then goes to a research detail setting page by clickingthe research detail setting page link 44 to set a detail researchcondition.

FIG. 13 is a diagram showing an example of a research condition settingscreen in the illegal use research service providing system according tothe first embodiment of the present invention. In FIG. 13, the researchcondition setting screen 50 includes a registration setting 51 of theresearch subject image, a registration setting 52 of a research period(report cycle), a type registration setting 53 of the research subjectimage, a registration setting 54 of a file attribute, a registrationsetting 55 of a site attribute, and a search start button 56. Theresearch client can select the image data to be research subject byclicking “REFER” button of the registration setting 51 of the researchsubject image. In this example, image data 51 a and 51 a are selectedimage data. Furthermore, in a case in that the image data 51 a and 51 bare set to be search subject, each check box is checked. Only image datawhere the check box is checked become the research subject. When twoimages (image data 51 a and 51 b) are checked, “or” search is conducted.

Next, in the registration setting 52 of the search period (reportcycle), it is possible to indicate to search retrospectively (trace backsearch). In this trace back search is indicated, a period of displayingthe image data 51 a and 51 b is required to indicate. Moreover, forexample, the report cycle/number can be indicated so as to be“daily×once”. The management server 12 distributes the research reportperiodically in accordance with this indicated schedule.

Next, in the type registration setting 53 of the research subject image,a type of the image data requested to search (for example, a photograph,a company mark, a trademark, a logo, or a like) can be indicated.Moreover, it is possible to indicate a different color of a main elementor indicate to ignore or a like.

Next, in the registration setting 54 of the file attribute, the formatof the image data requested to search (for example, JPEG, GIF, PNG, or alike) can be indicated. Moreover, a capacity range of the image datarequested to search (for example, 100 KB to 1000 KB, or a like) can beindicated. Furthermore, a size range of the image data requested tosearch (for example, length 100 dots×width 100 dots or a like) can beindicated.

The registration setting 55 of the site attribute is an item to checkwhen the research subject is limited. For example, it is possible toselect a method for liming the research subject from a domain type ofthe URL such as co.jp, ne.jp, or a like, a method for limiting theresearch subject from a general page type such as a top page of an HP(Home Page) a method for limiting the research subject for each pagelayer from a domain, or a like.

The research client clicks the search start button 56 at the researchcondition setting screen 50 after setting the above-described items.When the search start button 56 is clicked, a searching process forsearching for the similar image is started by the server system 10.

FIG. 14 is a diagram showing an example of a search result displayingscreen in the illegal use research service providing system according tothe first embodiment of the present invention. In FIG. 14, the searchresult displaying screen 60 includes an original (search subject) 61,search results 62, 63, and 64. Each of the search results 62, 63, and 64includes image data searched as the similar image, image informationconcerning image data, a site displaying the image data, and a linkbutton for linking a text creating screen for creating a text of thewarning/attention e-mail. The image information, for example, includesan URL, a file name, a similarity degree, an image size, a filecapacity, and a like. These search results are sorted by the similaritydegree. When the research client wants to send the warning/attentione-mail to a Web site based on the search result 64, the research clientclicks a link 64 a to go to the text creating screen for thewarning/attention e-mail.

As described above, the research client can easily specify the similarimage and the Web site displaying the similar image. Therefore, it ispossible to effectively make a plan against an unauthorized use of thetrademark or a like and bring the plan into practice at a proper timing.

A warning/attention e-mail creating form screen in the illegal useresearch service providing system will be described with reference toFIG. 15A and FIG. 15B. FIG. 15A is a diagram showing a state of settinga text example in a warning/attention e-mail creating form according tothe first embodiment of the present invention. FIG. 15B is a diagramshowing a state of additionally modifying the text example of thewarning/attention e-mail creating form according to the first embodimentof the present invention. In FIG. 15A and FIG. 15B, thewarning/attention e-mail creating form screen 70 includes a “CONFIRM”button 71, a “BACK TO MODIFY” button 72, and a “SEND” button 73. In FIG.15A and FIG. 15B, the warning/attention e-mail creating form screen 70includes items of “TEXT (PURPOSE) TYPE”, “RECEIVER ADDRESS”, “SENDERADDRESS (TO REPLY)”, “E-MAIL TITLE”, “WARNING/ATTENTION TEXT”, and alike.

In the item “TEXT (PURPOSE) TYPE”, a text registered beforehand in thetext example DB 14 can be selected and the contents (message) aredisplayed at the item “WARNING/ATTENTION TEXT”. In the item “RECEIVERADDRESS”, one e-mail address can be selected from a list of e-mailaddresses indicated in the Web site. In the item “SENDER ADDRESS (TOREPLY)”, an e-mail address obtained from the member informationregistered in the member DB 13 is set (and can be changed). The items“E-MAIL TITLE” and “WARNING/ATTENTION TEXT” can be approximately changedby the research client. FIG. 15B shows a state in that the items “E-MAILTITLE” and “WARNING/ATTENTION TEXT” are changed.

FIG. 16 is a diagram showing another example of the search resultdisplaying screen in the illegal use research service providing systemaccording to the first embodiment of the present invention. In FIG. 16,the search result displaying screen 80 includes an original (searchsubject) 81, search results 82, 83, and 84. Each of the search results82, 83, and 84 includes image data searched as the similar image, imageinformation concerning the image data, and a site displaying the imagedata. The search result displaying screen 80 is an example of a screenshowing the search results from searching for a Web page that is notlisted in the use permit list. In a case of the image data of the searchresult 82, the image data are displayed at a customer site. The color ofthis logo is not complied to the use policy and the background of thislogo is roughly cut out. In a case of the image data of the searchresult 83, the image data are displayed at a site that is nothing torelate to a business of the research client, and the background of thelogo is not uniformed. In a case of the image of the search result 84,the image data is displayed at a dealer site handling products of theresearch client, but the image data is not permitted to use for thedealer site. As described above, it is possible to easily confirmvarious states of displaying the image data at various Web sites,including the user permit and the unauthorized use. Therefore, it ispossible to effectively make a plan for a use of the trademark or a likeand bring the plan into practice at a proper timing.

The illegal use research service providing system according to the firstembodiment of the present invention is not limited to image dataconcerning the trademark and can be applied to various image data. Inthe following, an application example of another an image search servicewill be described.

FIG. 17 is a diagram showing further example of the search resultdisplaying screen in the illegal use research service providing systemaccording to the first embodiment of the present invention. In FIG. 17,the search result displaying screen 90 includes an original (searchsubject) 91, and search results 92, 93, and 94. Each of the searchresults 92, 93, and 94 includes image data searched as the similarimage, image information concerning the image data, and a sitedisplaying the image data. In this case, these search results show how aproduct of the research client (for example, a brand bag) is handled atWeb sites. From these search results, for example, by confirming whetheror not the Web site is a Web site being managed by an authorized agent,it is possible to research whether the product shown at the Web site isa stock from an authorized route or an imitation.

Moreover, it is possible to research whether or not a product image usedat an auction site is an official product image used by a manufacturerof the product or a distributor of the product. Furthermore, in anorganization having images as literary works made by a cameraman or anillustrator, it is possible to research whether or not the owned imagesare illegally used on a Web site.

In the first embodiment, each function realized in the illegal useresearch service providing system or apparatus for image data aredescribed. The present invention can be realized by a method forconducting each steps in the illegal use research service providingsystem or apparatus. Moreover, similar to the illegal use researchservice providing system or apparatus including each function, thepresent invention can be realized by a program for causing a computer tofunction as the illegal use research service providing system orapparatus. Furthermore, the present invention can be realized byinstalling the program recorded in a computer-readable recording medium.

An embodiment of the computer-readable recording medium recording theprogram and data to realize the illegal use research service providingfunction for the image data will be described according to the presentinvention. As the computer-readable recording medium, in detail, aCD-ROM (-R/-RW), a magneto-optical disk, a DVD-ROM, a FD (floppy disk),a flash memory, a memory card, a memory stick, and other various ROMsand RAMs can be used. It is possible to easily realize the illegal useresearch service providing function by recording and distributing theprogram causing a computer to function as each system according to thefirst embodiment of the present invention and realizing the illegal useresearch service providing function. Then, the program is installed fromthe computer-readable recording medium to a computer as an informationprocessing apparatus, and read out the program by a CPU of the computer,so as to realize the illegal use research served providing function.Alternatively, the program is recorded to the computer-readablerecording medium mounted to the information processing apparatus, andread out the program if necessary, so as to realize the illegal useresearch served providing function.

Second Embodiment

In a second embodiment, the present invention is applied to a proper useresearch service providing system or apparatus for researching whetheror not image data being permitted to user are properly used at Web siteson a network. In the second embodiment, processes, systemconfigurations, screens displayed at a client terminal of a researchclient are the same as those in the first embodiment and theexplanations will be omitted. In the second embodiment, the illegal useresearch in the first embodiment is replaced with a proper use research.The similarity degree in the first embodiment is replaced with a properdegree. The warning e-mail or the attention e-mail in the firstembodiment is replaced with the communication e-mail. Accordingly, onlydifferent portions from the first embodiment will be described in thefollowing.

A server apparatus and a client terminal in the proper use researchservice providing system of the present invention are the same as thoseas shown in FIG. 1 in the first embodiment.

FIG. 18 is a diagram showing a configuration example of the proper useresearch service providing system for the image data according to thesecond embodiment of the present invention. In FIG. 18, parts that arethe same as the ones in FIG. 2 in the first embodiment are indicated bythe same reference numerals and the explanation thereof will be omitted.In FIG. 18, the server system 10 functions to provide the proper useresearch service in the second embodiment. The Web site group 30 a is agroup of Web sites 311, 312, 313, . . . (hereinafter, often calledgenerally Web site 311), which are managed by related companies andagents which received the user permit from the research client, on thenetwork 22. In this case, the Web site 311 received and has already hadthe use permit to use the image data 15 a from the research client 20.The image data 15 a is a subject of the proper use research.

In the proper use research service providing system, it is checkedwhether or not the related company or the like, which has an agreementof the user permit concerning the image data (trademark, naming, logo,or a like as the research subject) set by the research client of anorganization, properly use the image data, and the check result can beinformed to the research client. Therefore, the research client canuniformly manage a brand image, including the related company and thelike.

Generally, the organization manages and monitors a trademarkapplication, and a trademark and regulates allowable color, size,character type, background, and these combinations in the use agreement(use agreement information) in detail. A user permitted to use (forexample, a related company, a distributor, a branch, an agent, or alike) complies this regulation and then display the trademark, thenaming, the logo of the contract partner at a top page of a related homepage, a product, an advertisement, or a like. This use regulation isdefined in order to uniformly manage the brand image, including therelated companies. Then, even the related company can conduct the sameuse management as a parent company. In this case, only a user of therelated company or the like, which has the use agreement, can use thetrademark or the like. In this system, the use agreement information isincluded in the user information 15B and registered to the researchsubject DB 15. Therefore, it is possible to determine whether or not theimage data 15 a is properly used in accordance with the user agreement.

The feature amount calculated by the feature amount calculating part isthe same as that in the first embodiment of the present invention (FIG.3), and the explanation thereof will be omitted.

The feature amount calculating process conducted by the feature amountcalculating part is the same as that in the in the first embodiment ofthe present invention (FIG. 4), and the explanation thereof will beomitted.

In the second embodiment, the similar image searching part 11 a can setthe proper degree based on the feature amount of the image data obtainedas the similar image. The search result informing part 12 c may sort theimage data in an order of higher proper degree set by the similar imagesearching part 11 a, and display the image data being sorted withinformation including at least the identification information (such asthe URL) of the Web site including the image data, the proper degree ofthe image data, and comment information of the image data, when thesearch result is display to inform the research client at the clientterminal 211. In addition, the search result informing part 12 c mayindividually display the image data having higher proper degree withdetail information based on the proper degree, individually display theimage data having a middle level of the proper degree without the detailinformation, and display only image data having lower proper degree atthe same screen, as a display (informing) method.

The proper degree shows a distance of the feature amounts (that is,distance between the research subject image and the test researchsubject) by a percentage in a case of using each feature amount as asingle measurement. The proper degree shows a distance of a weightedaverage of each feature amount by a percentage in a case of using aplurality of the feature amounts (in this embodiment, such as the color,the edge, the pattern, and the shape). This calculation is described asfollows:

proper degreed=K(color)×d(color)+K(edge)×d(edge)+K(pattern)×d(pattern)+K(shape)×d(shape)  (2)

In this calculation (2), K denotes a weight coefficient for each featureamount, and d denotes a value calculated as a distance between theresearch subject image and the test research subject image for eachfeature amount.

A user may determine that 100% of the proper degree shows quite similarto the original image and 0% of the proper degree shows not similar tothe original image. However, in this system, this calculation result isdetermined as a difference degree. Accordingly, the difference degree 0%corresponds to the proper degree 100%, and there is no distance betweenthe research subject image and the test research subject image, that is,the difference degree 0% is determined as quite similar to the originalimage. The difference degree 100% corresponds to the proper degree 0%,and there is a quite far distance between the research subject image andthe test research subject image, that is, the difference degree 100% isdetermined as not similar to the original image.

FIG. 19 is a flowchart for explaining an example of the proper useresearch service providing method for the image data according to thesecond embodiment of the present invention. This proper use researchservice providing method will be described based on the proper useresearch service providing system shown in FIG. 18. In FIG. 19, stepsthat are the same as the ones in FIG. 5 in the first embodiment areindicated by the same reference numerals and the explanation thereofwill be omitted.

In the step S19, the research purpose is the proper use research (YES),the proper use research concerning the image data is conducted (stepS21-2). The management server 12 registers the image data 15 a, theresearch condition 15 c, and the user information 15 b (step S22-2). Thesearch server 11 calculates the feature amount 15 d from the image data15 a being registered in the research subject DB 15 (step S23) andsearches for the similar image included in the Web site group 30 a suchas the related company and the like based on the feature amount 15 d andthe research condition 15 c (step S24-2).

Next, the search server 11 sets the proper degree based on the featureamount for the similar image searched in the step S24-2 (step S25-2).Then, the management server 12 sends the research report to the researchclient (client terminal 211), and the management server 12 generates anddistributes the communication e-mail corresponding to the proper degree(steps S26 through S28). Other steps are conducted similarly to thefirst embodiment (FIG. 5).

FIG. 20 is a diagram for explaining another configuration example of theproper use research service providing system for the image dataaccording to the second embodiment of the present invention. In FIG. 20,parts that are the same as the ones in FIG. 6 in the first embodimentare indicated by the same reference numerals and the explanation thereofwill be omitted. In this configuration, the Web site 311 has the useagreement with the research client 20.

FIG. 21 is a diagram for explaining further configuration example of theproper use research service providing system for the image dataaccording to the second embodiment of the present invention. In FIG. 21,parts that are the same as the ones in FIG. 7 in the first embodimentare indicated by the same reference numerals and the explanation thereofwill be omitted. In this configuration, the Web site 311 has the useagreement with the research client 20.

FIG. 22 and FIG. 23 are flowcharts for explaining another proper useresearch service providing method for the image data according to thesecond embodiment of the present invention. FIG. 22 is a diagram showinga process flow at the search server according to the second embodimentof the present invention. FIG. 23 is a diagram showing a process flow atthe search server according to the second embodiment of the presentinvention. This proper use research service providing method will bedescribed based on the proper use research service providing systemshown in FIG. 6 in the first embodiment.

Different from the first embodiment, in the step S39, when the researchpurpose is the proper use research (YES), the proper use research isconducted (step S41-2). The management server 12 registers the imagedata 15 a being the research subject, the research condition 15 c, andthe user information 15 b (a URL of the research subject Web site, useagreement, and a like) to the research subject Db 15 (step S42-2). Then,the management server 12 request the similar image search to the searchserver 11 (step S43).

In the steps S44 through S47, the proper degree of the similar image isobtained and informed to the management server 12.

In the steps S48 through S51, the communication e-mail corresponding tothe proper degree is generated and sent to the Web site displaying thesimilar image.

In FIG. 23, the search server 11 circulates the research subject Website group 30 of the related company and the like (step S52-2) and theimage data included in the research subject Web site 311 such as relatedcompany are searched for (step S53-2). The other steps are conductedsimilar to the first embodiment (FIG. 8 and FIG. 9).

FIG. 24 is a diagram showing an example of an agreement informationmanagement table for registering information concerning an agreement,according to the second embodiment of the present invention. In FIG. 24,the agreement information management table, for each company namecontracting the use agreement of the trademark (that is, company namethat received the user permit of the trademark), for example, items of aregistered date, trademark information (shown by an identificationnumber), agreement information (shown by an identification number), avalid term, image information (shown by an identification number), aURL, a counsel, a monitor, and a like are registered.

A trademark information management table is the same as that in thefirst embodiment (FIG. 10B), and a proper degree management table formanaging information concerning the proper degree is the same the properdegree management table for managing information concerning the properdegree in the first embodiment (FIG. 10C).

A service login screen in the proper use research service providingsystem according to the second embodiment of the present invention isthe same as the service login screen 40 in the illegal use researchservice providing system according to the first embodiment of thepresent invention (FIG. 12), and the explanation thereof will beomitted.

FIG. 25 is a diagram showing an example of a research condition settingscreen in the proper use research service providing system according tothe second embodiment of the present invention. In FIG. 25, the researchcondition setting screen 150 includes a registration setting 151 of theresearch subject image, a type registration setting 152 of the researchsubject image, a registration setting 153 of a file attribute, aregistration setting 154 of the research site, an estimated amountdisplay 155, and a search start button 156. The research client canselect the image data to be research subject by clicking “REFER” buttonof the registration setting 151 of the research subject image. In thisexample, image data 151 a and 151 a are selected image data.Furthermore, in a case in that the image data 151 a and 151 b are set tobe search subject, each check box is checked. Only image data where thecheck box is checked become the research subject. When two images (imagedata 51 a and 51 b) are checked, “or” search is conducted.

Next, in the type registration setting 152 of the research subjectimage, a type of the image data requested to search (for example, aphotograph, a company mark, a trademark, a logo, or a like) can beindicated. Moreover, it is possible to indicate a different color of amain element or indicate to ignore or a like.

Next, in the registration setting 153 of the file attribute, the formatof the image data requested to search (for example, JPEG, GIF, PNG, or alike) can be indicated.

Moreover, a capacity range of the image data requested to search (forexample, 100 KB to 1000 KB, or a like) can be indicated. Furthermore, asize range of the image data requested to search (for example, length100 dots×width 100 dots or a like) can be indicated.

The registration setting 54 of the research subject site is an item forchecking to limit the research subject. In this case, it is possible toselect a Web site, which is permitted to use the image data being theresearch subject by the use agreement between the organization of theresearch client and the related company. The research client can selecta Web site to be the research subject by clicking a “REFER” button ofthe registration setting 154 of the research subject sites. Moreover,the research client can select a Web site managed by a distributorhandling a product of the research client, which use the image datawithout the user permit but can be overlooked. The research client canselect a Web site to be the research subject by clicking the “REFER”button of the registration setting 154 of the research subject site.When the research client registers a new research subject Web site, theresearch client can register from the registration setting 54 of theresearch subject site.

The estimate amount display 155 automatically calculates an estimateamount according to the proper use research based on the image data andthe research condition.

The research client sets each item described above and then clicks thesearch start button 156 at the research condition setting screen 150.When the search start button 156 is clicked, the server system 10 startsthe searching process for the similar image.

A search result displaying screen in the proper use research serviceproviding system is similar to that in the illegal use research serviceproviding system in the first embodiment (FIG. 14) and the explanationthereof will be omitted.

A communication e-mail creating form screen in the proper use researchservice providing system is similar to the waning/attention e-mailcreating form screen in the illegal use research service providingsystem in the first embodiment (FIG. 15A and FIG. 15B) and theexplanation thereof will be omitted.

Another search result displaying screen in the proper use researchservice providing system is similar to that in the illegal use researchservice providing system in the first embodiment (FIG. 16) and theexplanation thereof will be omitted.

A further search result displaying screen in the proper use researchservice providing system is similar to that in the illegal use researchservice providing system in the first embodiment (FIG. 17) and theexplanation thereof will be omitted.

In the second embodiment, each function realized in the proper useresearch service providing system or apparatus for image data aredescribed. The present invention can be realized by a method forconducting each steps in the proper use research service providingsystem or apparatus. Moreover, similar to the proper use researchservice providing system or apparatus including each function, thepresent invention can be realized by a program for causing a computer tofunction as the proper use research service providing system orapparatus. Furthermore, the present invention can be realized byinstalling the program recorded in a computer-readable recording medium.

An embodiment of the computer-readable recording medium recording theprogram and data to realize the proper use research service providingfunction for the image data will be described according to the presentinvention. As the computer-readable recording medium, in detail, aCD-ROM (-R/-RW), a magneto-optical disk, a DVD-ROM, a FD (floppy disk),a flash memory, a memory card, a memory stick, and other various ROMsand RAMs can be used. It is possible to easily realize the proper useresearch service providing function by recording and distributing theprogram causing a computer to function as each system according to thesecond embodiment of the present invention and realizing the proper useresearch service providing function. Then, the program is installed fromthe computer-readable recording medium to a computer as an informationprocessing apparatus, and read out the program by a CPU of the computer,so as to realize the proper use research served providing function.Alternatively, the program is recorded to the computer-readablerecording medium mounted to the information processing apparatus, andread out the program if necessary, so as to realize the proper useresearch served providing function.

The present invention is not limited to the specifically disclosedembodiments, and variations and modifications may be made withoutdeparting from the scope of the present invention.

The present application is based on the Japanese Priority ApplicationsNo. 2003-185636 filed on Jun. 27, 2003, No. 2003-185690 filed on Jun.27, 2003, No. 2004-151265 filed on May 21, 2004, and No. 2004-151474filed on May 21, 2004, the entire contents of which are herebyincorporated by reference.

1-15. (canceled)
 16. A server apparatus for conducting an illegal useresearch of image data requiring a use permit, said server apparatuscomprising: a research subject registering part registering image datareceived from the research client as a research subject to a researchsubject database for each research client; a research condition settingpart setting a research condition for research whether or not the imagedata being registered are illegally used by a Web site on a network; asimilar image searching part calculating a feature amount of the magedata registered by said research subject registering part, and searchingfor image data being identical or similar to the image data of theresearch subject based on the feature amount being calculated and theresearch condition; and a search result informing part informing asearch result by said similar image searching part as a research reportto the research client.
 17. A method for providing an illegal useresearch service for image data by a server apparatus connectable to aclient apparatus used by a research client requesting the illegal useresearch for the image data requiring a use permit through a network,said method comprising the steps of: registering image data receivedfrom the client apparatus as research subject to a research subjectdatabase for each research client; setting a research condition forresearching whether or not the image data being registered are illegallyused; calculating a feature amount of the image data being registered insaid registering image data and searching for image data being identicalor similar to the image data of the research subject based on thefeature amount being calculated and the research condition; andinforming a search result as a research subject to the research clientusing the terminal apparatus.
 18. The method as claimed in claim 17,wherein said feature amount of at least one of a color, a pattern, ashape, and a layout of the image data as a subject of the illegal useresearch is calculated.
 19. The method as claimed in claim 17, whereininformation concerning a user, who received the use permit of the usepermit, and identification information of a Web site managed by the useris registered with the image data as the subject of the illegal useresearch and the feature amount of the image data to the researchsubject database for each research client.
 20. The method as claimed inclaim 19, wherein the research condition, which excludes the Web sitemanaged by the user being registered in the research subject databasefrom the subject of the illegal use research, can be set.
 21. The methodas claimed in claim 17, wherein as the research condition, at least oneof a data format, a data capacity, and a data size of the image data asthe subject of the illegal use research can be set.
 22. The method asclaimed in claim 17, wherein as the research condition, at least one ofa domain type, a page type, and a page layer of the Web site as thesubject of the illegal use research can be set.
 23. The method asclaimed in claim 17, wherein when image data being identical or similarto the image data as the research subject are searched for, apredetermined range is set for the feather amount of the image dataregistered in the research subject database, image data having thefeature amount being within the predetermined range are searched for asa similar image from image data included in the Web site on the network,and the image data searched as the similar image and identificationinformation of the Web site including the image data are obtained. 24.The method as claimed in claim 17, further comprising the step ofcirculating the Web site on the network, calculating the feature amountof the image data included in the Web site being circulated, andregistering information concerning the calculated feature amount to thefeature amount database by relating to the identification information ofthe Web site, wherein when image data being identical or similar to theimage data as the research subject, a predetermined range is set for thefeature amount of the image data registered in the research subjectdatabase, the feature amount being within the predetermined range issearched from the feature amounts registered in the feature amountdatabase, and as a result, the image data corresponding to the featureamount being searched and identification information of the Web siteincluding the image data.
 25. The method as claimed in claim 23, whereinwhen the similar image is searched for, the similarity degree is setbased on the feature amount with respect to the image data obtained as asimilar image, and wherein when the search result is displayed andinformed at the terminal apparatus, image data are sorted in an order ofa higher similarity degree, the sorted image data are displayed withimage information including at least the identification information ofthe Web site including the image data and the similarity degree of theimage data.
 26. The method as claimed in claim 25, wherein the textexamples, of which contents are different each other, of the warninge-mail are stored in a text example database, and when the warninge-mail is sent to the Web site including the similar image beingsearched, a text example corresponding to the similarity degree of thesimilar image is selected from the text example database, the selectedtext example is set to the warning e-mail, and the warning e-mailsetting the selected text example is sent to an e-mail address includedin the Web site.
 27. The method as claimed in claim 26, wherein beforethe warning e-mail setting the selected text example from the textexample database is sent to the e-mail address included in the Web site,the warning e-mail is sent to the client apparatus of the researchclient, and the warning e-mail is sent to the e-mail address included inthe Web site after the research client approves or modifies the contentof the warning e-mail.
 28. (canceled)
 29. A program product for causinga computer to function as a server apparatus for conducting an illegaluse research of image data requiring a use permit, said program productcomprising the codes for: registering image data received from theresearch client as a research subject to a research subject database foreach research client; setting a research condition for research whetheror not the image data being registered are illegally used by a Web siteon a network; calculating a feature amount of the mage data registeredby said registering image data, and searching for image data beingidentical or similar to the image data of the research subject based onthe feature amount being calculated and the research condition; andinforming a search result by said searching as a research report to theresearch client.
 30. A program product for causing a computer to anillegal use research service for image data by a server apparatusconnectable to a client apparatus used by a research client requestingthe illegal use research for the image data requiring a use permitthrough a network, said program product comprising the codes for:registering image data received from the client apparatus as researchsubject to a research subject database for each research client; settinga research condition for researching whether or not the image data beingregistered are illegally used; calculating a feature amount of the imagedata being registered in said registering image data and searching forimage data being identical or similar to the image data of the researchsubject based on the feature amount being calculated and the researchcondition; and informing a search result as a research subject to theresearch client using the terminal apparatus.
 31. A computer-readablerecording medium recorded with a program for causing a computer to anillegal use research service for image data by a server apparatusconnectable to a client apparatus used by a research client requestingthe illegal use research for the image data requiring a use permitthrough a network, said program comprising the codes for: registeringimage data received from the client apparatus as research subject to aresearch subject database for each research client; setting a researchcondition for researching whether or not the image data being registeredare illegally used; calculating a feature amount of the image data beingregistered in said registering image data and searching for image databeing identical or similar to the image data of the research subjectbased on the feature amount being calculated and the research condition;and informing a search result as a research subject to the researchclient using the terminal apparatus. 32-45. (canceled)
 46. A serverapparatus for conducting a proper use research of image data permittedto use, said server apparatus comprising: a research subject registeringpart registering image data received from the research client as aresearch subject to a research subject database for each researchclient; a research condition setting part setting a research conditionfor research whether or not the image data being registered are properlyused by a research subject Web site on a network; a similar imagesearching part calculating a feature amount of the mage data registeredby said research subject registering part, and searching for image databeing identical or similar to the image data of the research subjectbased on the feature amount being calculated and the research condition;and a search result informing part informing a search result by saidsimilar image searching part as a research report to the researchclient.
 47. A method for providing a proper use research service forimage data by a server apparatus connectable to a client apparatus usedby a research client requesting the proper use research for the imagedata permitted to use through a network, said method comprising thesteps of: registering image data received from the client apparatus asresearch subject to a research subject database for each researchclient; setting a research condition for researching whether or not theimage data being registered are properly used; calculating a featureamount of the image data being registered in said registering image dataand searching for image data being identical or similar to the imagedata of the research subject based on the feature amount beingcalculated and the research condition; and informing a search result asa research subject to the research client using the terminal apparatus.48. The method as claimed in claim 47, wherein said feature amount of atleast one of a color, a pattern, a shape, and a layout of the image dataas a subject of the proper use research is calculated.
 49. The method asclaimed in claim 47, wherein as the research condition, at least one ofa data format, a data capacity, and a data size of the image data as thesubject of the proper use research can be set.
 50. The method as claimedin claim 47, wherein as the research condition, at least one of a domaintype, a page type, and a page layer of the Web site as the subject ofthe proper use research can be set.
 51. The method as claimed in claim47, wherein in said registering image data registers use agreementinformation concerning a use agreement of the image data contractedbetween the research client and the user who received the user permitfrom the research client, to the research subject database, and saidsearching for image data includes a checking whether or not image dataincluded in the research subject Web site on the network is used inaccordance with the contract contents regulated in the use agreementinformation.
 52. The method as claimed in claim 47, wherein apredetermined range for the feature amount of the image data beingregistered in the research subject can be set when searching for imagedata which are identical or similar to the image data being researchsubject, image data having the feature amount being within thepredetermined range can be searched for from image data included in theresearch subject Web site on the network as a similar image, and theimage data searched as the similar imaged and identification informationof the research subject Web site including the image data can bespecified.
 53. The method as claimed in claim 47, further comprising thestep of circulating a research subject Web site on the networkperiodically, calculating the feature amount form the image dataincluded in the research subject Web site being circulated, andregistering information concerning the feature amount being calculatedto a feature amount database by associating the information withidentification information of the research subject Web site, wherein apredetermined range for the feature amount of the image data beingregistered in the search subject database can be set when searching forimage data being identical or similar to the image data being theresearch subject, the feature amount being within the predeterminedrange can be searched for from the feature amounts registered in thefeature amount database, and the image data corresponding to the featureamount being searched and the identification information of the researchsubject Web site including the image data as a search result can bespecified.
 54. The method as claimed in claim 52, wherein: a properdegree with respect to image data obtained as the similar image based onthe feature amount of the image data can be set; and image data can besorted in an order of a higher proper degree when displaying andinforming the search result at the terminal apparatus, and the imagedata being sorted can be displayed with image information including atleast one of the identification information of the research subject Website, the proper degree of the image data, and comment informationconcerning the image data
 55. The method as claimed in claim 54,wherein: text examples showing different contents for a communicatione-mail corresponding to the proper degree set for each image data arestore in a text example database beforehand; the communication e-mail issent to the research subject Web site including the similar image; andwhen the communication e-mail is sent to the research subject Web siteincluding the similar image, one text example corresponding to theproper degree of the similar image is selected from the text exampledatabase, the selected text example is set to the communication e-mail,and the communication e-mail setting the selected text example is sentto an e-mail address included in the research subject Web site.
 56. Themethod as claimed in claim 55, wherein the communication e-mail settingthe selected text example from the text example database is sent to theterminal apparatus of the research client before the communicatione-mail is sent to the e-mail address included in the research subjectWeb site, and the communication e-mail is sent to the e-mail addressincluded in the research subject Web site after the research clientconfirms or modifies contents of the communication e-mail. 57.(canceled)
 58. A program product for causing a computer to conduct aproper use research of image data permitted to use, said program productcomprising the codes for: registering image data received from theresearch client as a research subject to a research subject database foreach research client; setting a research condition for research whetheror not the image data being registered are properly used by a researchsubject Web site on a network; calculating a feature amount of the magedata being registered, and searching for image data being identical orsimilar to the image data of the research subject based on the featureamount being calculated and the research condition; and informing asearch result by said similar image searching part as a research reportto the research client.
 59. A program product for causing a computer toexecute a method for providing a proper use research service for imagedata by a server apparatus connectable to a client apparatus used by aresearch client requesting the proper use research for the image datapermitted to use through a network, said program product comprising thecodes for: registering image data received from the client apparatus asresearch subject to a research subject database for each researchclient; setting a research condition for researching whether or not theimage data being registered are properly used; calculating a featureamount of the image data being registered in said registering image dataand searching for image data being identical or similar to the imagedata of the research subject based on the feature amount beingcalculated and the research condition; and informing a search result asa research subject to the research client using the terminal apparatus.60. (canceled)